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ABSTRACT 

Imaging of z > 3.4 radio galaxy fields below the Lyman continuum wave- 
length allows companion galaxies to be identified on the basis of red colours 
across the wavelength of redshifted Lya and very red colours across the red- 
shifted Lyman continuum. These arise due to a combination of absorption 
by intervening Lya forest and Ly man-limit systems, and intrinsic Ly man- 
limit breaks in the galaxy spectral energy distribution caused by an Hi 
screen or breaks in stellar spectra. As a pilot study we have imaged the 
field of the z = 3.8 radio galaxy 4C41.17 in I/, V and R with the Auxil- 
iary Port of the WHT. We find a number of potential companion galaxies, 
which require confirmation via spectroscopy or narrow-band imaging. The 
Lyman-limit in the spectrum of the radio galaxy itself and its implications 
for the origin of the UV flux is also discussed. 

Key words: galaxies: formation - galaxies: individual (4C41.17) - 

galaxies: active 


1 INTRODUCTION 

With the advent of CCD detectors with good re- 
sponses in the near-UV, the technique of Lyman-limit 
imaging has become one of the most promising meth- 
ods of finding normal galaxies (i.e. galaxies without 
powerful AGN) at high redshifts. Star-forming galax- 
ies should be identifiable via a flat spectrum (in flux 
density f y vs. frequency i/) longward of Lya, a break 
shortward of the Lya wavelength caused by interven- 
ing Lya forest clouds and a further break at the Ly- 
man continuum wavelength (the “Lyman-limit”), due 
to the combination of an intrinsic continuum break of 
> 2 (Bruzual &: Chariot 1993), accumulated absorp- 
tion by intervening Lya forest clouds and the like- 
lihood of high optical depth absorption by interven- 
ing Lyman-limit systems (Moller & Jakobsen 1990). 
This method has the great advantage of being rela- 
tively unaffected by dust compared to optical searches 
for Lya emission from these objects. By searching for 
this characteristic spectral signature, suitable samples 
can be selected for further study via optical/IR spec- 
troscopy and further broad-band imaging with the 
aim of estimating the star-formation rates and masses 
of these objects. 


Previous uses of this technique have involved field 
samples (e.g. Guhathakurta, Tyson L Majewski 1990; 
Lilly, Cowie iz Gardiner 1991) and a region around the 
quasar Q0000-263 which contains a damped Lya sys- 
tem at z = 3.4 (Steidel &; Hamilton 1992,1993). The 
field samples turned up no significant population of 
high -2 objects, but the field of Q0000-263 turned out 
to have a large number (16 in ~ 15 aremin 2 ) of poten- 
tial z > 3 galaxies, a result which Giavalisco, Steidel 
&; Slazay (1994) identify as the detection of a possible 
z = 3.4 cluster. Imaging of four other fields around 
damped absorbers (Steidel, Pettini &z Hamilton 1995) 
find that a more typical density of Lyman-limit can- 
didates is « 0.5 aremin -2 to a flux limit of 71 = 25 
(i.e. R zs 24.7), corresponding approximately to the 
number expected if there is no evolution in the normal 
galaxy population out to z ~ 3.5. 

We are basing our strategy on radio galaxy fields. 
Radio galaxies in the local Universe are identified 
with the most massive elliptical galaxies [with lumi- 
nosities 3 Lm, where Z* is the break luminosity in 
the Schechter (1976) function], which at early times 
may have corresponded to the high peaks in the spec- 
trum of density fluctuations. These fluctuations are 
expected to have roughly equal power on all scale- 
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lengths, with the effect that lesser peaks (which might 
form galaxies < L *) tend to be clustered around the 
highest peaks, an effect often termed biassing. The 
radio luminosity of a radio galaxy with a given bulk 
power in its radio jets is also a strong function of envi- 
ronmental density (Rawlings 1992), creating a further 
bias towards radio galaxies being found in high den- 
sity regions. Observational evidence for the existence 
of such effects comes from the high fraction of c ~ 0.5 
radio galaxies and quasars found in clusters (Hill k 
Lilly 1991; Ellingson, Yee k Green 1991). 

In this paper we report on a pilot study of the 
field of the redshift 3.8 radio galaxy 4C41.17 (Cham- 
bers, Miley k van Breugel 1990; hereafter Ch90). This 
well-studied system has several properties which make 
a study of this sort valuable. Deep imaging in A -band 
with the Keck Telescope (Graham et al. 1994; here- 
after G94) shows up several red companion galaxies, 
possibly indicating the presence of a group or cluster 
around or in front of the radio galaxy. Imaging of the 
radio galaxy itself with the HST shows a high degree 
of correlation between the radio and optical structures 
(Miley et al. 1992). Detections with the JCMT (Dun- 
lop et al. 1994) and IRAM (Chini k Kriigel 1994) 
indicate the presence of large amounts (10 8 — 10 9 Mq) 
of dust, either in the galaxy itself, or in nearby ob- 
jects within the 11- and 16.5-arcsec diameter beams 
of IRAM and the JCMT respectively. 


2 OBSERVATIONS 

The 4C41.17 field was observed bv the William Her- 
schel Telescope (WHT) at the // 11 Auxiliary Port on 
the nights of 1995 January 25,26 and 28. In addition a 
A'-band observation of the part of the Auxiliary Port 
field not visible in the Keck image was made with IR- 
CAM3 at the UKIRT 1995 March 24. Details of the 
imaging observations are shown in Table 1. (The ob- 
servations made on 1995 January 26 were affected by 
stray light emanating from the GHRIL cage of the 
WHT; this had a negligible effect on the £-band ob- 
servations, but added significant excess background 
to the V- and A-band images taken that night.) The 
seeing on the final A-band image was 1.4-arcsec, 

Flux calibration was achieved by observing the 
standard stars 94401 and PG 1514+034 (Landholt 
1992). A correction for colour was found necessary 
in A-band only due to the asymmetric profile of the 
Harris A filter. Airmass corrections were estimated 
by scaling the V'-band extinction measurements made 
by the Carlsberg Automatic Meridian Circle accord- 
ing to the standard La Palma extinction curve (King 
1985). A further correction was made to allow for 
the effects of the extinction in the Milky Way. The 
reddening was estimated to be E(B — V) = 0.12 
from the map of Burstein k Heiles (1982), assuming 
Av = 3.1 £(5 - V) gave Av = 0.37. Corresponding 
values of extinction as a function of wavelength in 


U and R were calculated from the curves of Cardelli, 
Clayton k Mathis (1989). We also checked the lOO^rn 
map of the region made by IRAS', after subtraction of 
a comparable contribution of zodiacal light, the cir- 
rus towards 4C41.17 had a flux of 6.2 M Jysr“ 1 , corre- 
sponding to Av ss 0.3 — 0.4 assuming 18 ± 3 M Jysr -1 
per magnitude in Ay (Beichmann 1987). 


3 ANALYSIS 

The initial data reduction was performed in IRAF us- 
ing standard routines to bias subtract and flatfield the 
data, and to align the U , V and R frames to within 
a pixel. The routine IMSURFIT was then used to fit a 
polynomial surface to the final images, which was then 
subtracted in order to remove large-scale fluctuations 
in the background level, mostly caused by scattered 
light from bright stars within the camera. The pro- 
cessed frames were then block averaged by five pixels 
in x and y to correctly sample the relatively poor see- 
ing. The STARLINK PISA package was then used to find 
and classify the images on the A-band frame, to pro- 
duce a finding list to define the set of objects for pho- 
tometry. The total area surveyed was 1.49 arcmin 2 . 
Aperture photometry was then performed on each of 
the objects detected in the A-band image using circu- 
lar apertures with radii close to the source sizes found 
by PISA (except for the objects common to the K- 
selected sample of G94 which all have photometry in 
3-arcsec diameter apertures). The results of this anal- 
ysis are given in Table 2, and a finding chart is given 
in Fig. 1. The total A magnitudes were estimated by 
PISA using a “curve of growth” analysis (Kron 1980) 
are also listed in Table 2, along with an indication 
of whether the objects are stellar or extended on the 
basis of the HST image of Miley et al. (1992). In Ta- 
ble 3, we show our measurements and limits for the 
A'-band selected objects of G94 undetected by PISA 
in our A-band image, in 3-arcsec diameter circular 
apertures. 

We made an estimate of the completeness of, 
and errors in, our mini-survey by adding in gaussian 
objects of known magnitudes with full- width- half- 
maxima equal to the seeing using the ARTDATA pack- 
age within IRAF, processing the frames in the same 
manner as the data frames, and then running pisa to 
recover them. These tests showed that the error in the 
total magnitudes of Table 2 at A to t % 24 are about 
0.5 mag. The completeness at this flux level is about 
80 per cent, falling to 60 per cent by A to t ~ 24.4. The 
errors and incompleteness are dominated by residual 
background fluctuations in the images. 
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Table 1. Imaging of the 4C41.17 
Telescope/ Instrument/ 

field 

Filter 

Date Exposure time 

Seeing 

Notes 

configuration Detector 

WHT Aux Port TEK5 

V 

25/1/95 

/seconds 

14400 

/arcsec 

1.0 

light cirrus 

WHT Aux Port TEK5 

u 

26/1/95 

15300 

2.0 

clear 

WHT Aux Port TEK5 

V 

26/1/95 

2700 

2.0 

clear; backgrounds 2x normal value 

WHT Aux Port TEK5 

R 

26/1/95 

2700 

2.0 

clear; background % 3x normal value 

WHT Aux Port TEK5 

V 

28/1/95 

1800 

1.6 

clear 

WHT Aux Port TEK5 

R 

28/1/95 

1800 

1.6 

clear 

UKIRT Cass IRCAM3 

K 

24/3/95 

810 

1.6 

clear 

Table 3. Magnitudes and colours of the objects listed in 

G94 undetected by PISA 


Object 

R 

&R V 

AV U 

A U 

R - K A R- K 

No. in G94 
2 

>25.6 

>26.1 

>25.4 


>4.5 

4 

>25.6 

>26.1 

>25.4 


>4.8 

5 

>25.6 

>26.1 

>25.4 


>4.2 

6 

>25.6 

>26.1 

>25.4 


>4.4 

9 

>25.6 

>26.1 

>25.4 


>3.3 

12 

>25.6 

25.7 

0.27 25.0 

0.25 

>4.8 

14 

>25.6 

>26.1 

>25.4 


>4.0 

16 

25.1 

0.23 25.0 

0.14 >25.4 


6.7 0.23 

17 

24.9 

0.19 25.0 

0.14 >25.4 


3.9 0.29 

18 

25.5 

0.33 >26.1 

>25.4 


6.0 0.34 


Notes: G94 object 12 is object V of Chambers et al. (1990). The errors include Poisson noise only (see notes to Table 2). 


4 DISCUSSION 

4.1 The field objects 

Our field search is sensitive to galaxies in the range 
2 ~ 3 — 5, i.e. from where the Lyman limit moves 
into the {/-band until it exits the V-band, although 
for the reasons given in Section 1 we expect that any 
field objects are likely to be at a similar redshift to 
the radio galaxy. Apart from 4C41.17, there are sev- 
eral field objects which have spectral energy distribu- 
tions (SEDs) consistent with high redshift galaxies. 
We have plotted the SEDs of these objects in Fig. 
2 (a)-(f). LR4 is particularly interesting, as besides 
showing a strong spectral break between U and V , it 
also has a break across Lya, consistent with Lya for- 
est absorption, and also is the only object apart from 
4C41.17 in the field of G94 which shows a significant 
K — Ks excess (corresponding perhaps to high EW 
[Om]495.9/500.7 lines). Its comparative brightness, 
though, argues against an interpretation as a com- 
panion galaxy to 4C41.17 unless it harbours an AGN 
(it is even brighter in Ks, corresponding to & 100L* 
at 2 = 3.8). LR7 is very faint, so the limit in (/-band is 
relatively poor, making it hard to eliminate the possi- 
bility of it being at low- 2 . LRll shows a strong break 
between V and R , and is undetected in U. LR14 is 
undetected in U , but its SED is very red from K to 
V . LR19 is a good candidate, with a possible break 
between V and R and a clear break between U and 
V\ and faint in A'-band. LR21 is undetected in U, but 


shows no break between R and V\ so is most likely to 
be a low- z galaxy or a star. 

In the absence of spectroscopic confirmation, we 
cannot yet be certain that any of these candidates 
are at z > 3. Likely contaminants include cool stars 
and early-type galaxies at moderate redshifts (~ 0.3). 
Where our field overlaps the HST field of Miley et al. 
(1992), we can be fairly sure that we have correctly 
identified the stars. The only one of our Lyman-limit 
candidates which appears stellar in the HST image 
is LR6 [Fig. 2(g)], although is is still possible that it 
could be a reddened AGN at high- 2 , or a very compact 
galaxy. Moderate redshift earlv-type galaxies produce 
the largest contaminant problem. In Fig. 2(h) we show 
an early-type galaxy spectrum redshifted to 0.2,0. 3 
and 0.5. Clearly, at any of these redshifts the possi- 
bility of confusion with a Lyman-limit object is high, 
as all have very red U — V colours [e.g. at z = 0.3. 
U — V = 2.2 for such a galaxy (Coleman, Wu Weed- 
man 1980)]. V — R colours could help in principle, but 
due to Lyman forest absorption we expect our high-r 
galaxies to have red V — R too. The best discriminant 
is probably the R — K colour, which should be % 2 for 
a flat-spectrum object, but 3-5 for z = 0.2 — 0.5 early- 
type galaxies (e.g. Dunlop et al. 1989). Of our Lyman- 
limit candidates, LR4, LRll and LR14 all have mea- 
sured R — K > 3, and LR19 and LR21 have limits in 
K which are too poor to discriminate. It is therefore 
likely that many of our candidates are only at mod- 
erate redshifts, although it is also possible that the 
high- z galaxies we are searching for are red, in which 
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Figure 1 . Finding chart for the objects listed in Table 2 made from our J?-band image. The apertures used for the 
photometry detailed in Table 2 are shown to scale where possible, otherwise the objects are indicated by arrows. Ln the 
case of 4C41.1T> the 6 X 4 arcsec 2 aperture of Ch90 is shown on which the points in Fig. 3 are based, in preference to the 
3-arcsec diameter aperture used in Table 2. North is to the top and east to the left. The image has been smoothed with a 
a = 1-pixel gaussian. 


case the R — K discriminant is not useful. We confirm 
that the very red objects detected by G94 near to the 
radio galaxy (G94 objects 4-6,9,12) are all plausible 
high-z galaxy candidates, with the exception of object 
12 (object V of Ch90), which is marginally detected 
on both our V and £ r -band images. 

Comparing our results with those of Steidel et al. 
(1995), we find a somewhat higher density of Lyman 
limit candidates (6 in ss 1.5 arcmin” 2 , i.e. all in Fig. 
2 excluding LR21), although our selection criteria are 
not identical, so it is hard to make direct comparisons. 
It is clear though, based on the R — K colours that 
either many of these objects are much lower redshift 
galaxies with early-type spectra or that the high -2 
galaxy population is predominately not flat spectrum, 


perhaps because their epoch of maximum star forma- 
tion was further back in the past. There is, however, 
no evidence from either the number counts of galaxies 
in R compared to those of Tyson (1988) or from the 
galaxy colours of a substantial population of unusual 
galaxies in this field. 


4.2 The radio galaxy 

There is a clear spectral break towards {/-band in 
the SED of the radio galaxy, even after allowance has 
been made for the Lyo forest absorption in V-band 
(Fig. 3). As discussed in M0ller & Jakobsen (1990) 
and Madau (1995), beyond the Lyman-limit strong 
absorption is expected from both the accumulated 
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Figure 2. (a)-(g) Spectral energy distributions of the potential Lyman-limit systems. In the case of LR4, the point 
corresponding to the A'-band magnitude is plotted as a dot and the cross is the K s magnitude, for all the other objects the 
K magnitude only is plotted. The two vertical dashed lines indicate the positions of the Lyman-limit and Lya redshifted 
to ^ = 3.8. (h) The “cold E/SO” SED at an age of 13 Gyr from the model of Rocca-Volmerange & Guiderdoni (1988) 
redshifted to z — 0.2 (top curve), z = 0.3 (middle curve) find z = 0.5 (bottom curve), (i) The SED of 4C41.17. Flux 
densities are measured in the “galaxy” 6x4 arcsec 2 aperture of Ch90. Dots represent the best estimate of the SED 
without lines and are from left to right V , V and R-band observations from this paper (the V and R-band observations 
have Lya subtracted using the value of the Lya flux from Ch90), line-free R-band from the HST observation of Miley et 
al. (1992), /-band from Ch90, and A' s -band from G94, aperture corrected by comparing the A'-band magnitude of Ch90 
with that of G94. The crosses represent the V , R (from this paper) and A' (from G94) magnitudes including line emission. 
The dotted lines are correspond to a 1-Gyr burst 10 n A/Q BruzuaJ model (e.g. Bruzual & Chariot 1993) after 5 x 10 8 
yr, (i.e. a star formation rate of lOOM0yr -1 ) (top curve between 912Aand 1216A), and (bottom curve) attenuated by 
median Lyman forest absorption coefficients appropriate to z = 3.8 estimated from fig. 9 of Warren, Hewett & Osmer 
(1994). Beyond the Lyman-limit, absorption is dominated by Lyman-limit systems, and is very dependent on the number 
of Lyman-limit systems along the line of sight, so we have not attempted to plot this. 
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opacity of the Lyman-limits of Lya forest systems, 
and intervening Lvman-limit systems with redshifts 
such that they fall within the bandpass of the U fil- 
ter (z % 2.7 — 3.8). Scaling from Figs. 5 and 6 of 
Moller & Jakobsen (1990), only 5 per cent of ran- 
dom lines of sight from z — 3.8 will have transmis- 
sion £ 10 per cent at the rest wavelengths sampled 
by our {7-band filter, and a typical line of sight will 
only have a transmission of a few per cent. This rein- 
forces the value of Lyman-limit imaging for detecting 
high-5 galaxies, for even if the galaxy spectrum shows 
only a modest Lyman-limit break, due to e.g. a very 
young stellar population, or radiation from supernova 
remnants dominating the UV light (Bithell 1991), we 
still expect a large observed break from intervening 
absorption. The corollary, however, is that Lyman- 
limit imaging has a restricted value for determining 
the UV emission mechanism in the radio galaxy itself. 

Spectroscopic detections of the Lyman-limit are 
less likely to be confused by the presence of interven- 
ing absorbers due to the far superior wavelength res- 
olution. For example, Storrie-Lombardi et al. (1994) 
find only 6/68 quasars in the range z = 2.8 — 4.5 with 
Lyman-limit systems within 4000 kms” 1 . The disad- 
vantage is that the wavelength dispersion makes de- 
tections at a given signal- to- noise ratio much harder. 
Nevertheless, a spectroscopic detection of a Lyman- 
limit break in 4C41.17 was reported bv Dickinson, 
Spinrad L Liebert (1991). 

An intrinsic break, if present, could have one of 
two physical causes; either it reflects breaks in stel- 
lar spectra (thus implying that the near-LTV light is 
dominated by stars), or it is due to Hi absorption by a 
screen of Hi in front of the UV-emitting region of the 
galaxy with a column density A ; (Hl)> 1.6 x 10 21 m~ 2 
(e.g. Storrie-Lombardi et al. 1994). It is hard to elim- 
inate the possibility of the existence of such a screen, 
but the lack of evidence for strong absorption in the 
Lya line [the Fabrv-Perot observations of Hippelein 
Meisenheimer (1993) detect only alow column den- 
sity absorber and there is no significant velocity offset 
between the Lya and [Olll]500.7 (Eales & Rawlings 
1993)] argues against one being present. 

In the absence of such a screen, UV light with 
an intrinsic Lyman-limit break is most likely to come 
from stars. Scattering can be ruled out provided there 
is a negligible amount of Hi mixed in with the scat- 
tered and there is no intrinsic break in the quasar 
spectrum at 912A. Although a a dust and Hi mix- 
ture would be able to create a Lyman-limit break in 
scattered light, this would create the same effect on 
the Lya emission as an Hi screen between the UV- 
emitting region and the Lya halo discussed previ- 
ously. An additional argument against scattering was 
provided by Miley et al. (1992) who noted that the 
close radio-optical correspondences in the HST image 
also made a scattered light model unlikely. 

Nebular continuum emission can probably be 
eliminated too: Dickson et al. (1995) suggest that 


nebular continuum emission should contribute a sig- 
nificant fraction of the UV flux from 4C41.17. The 
contribution of the nebular continuum is critically 
dependent on the mechanisms for Lya production 
and suppression. Eales &: Rawlings (1993) measure 
Fhya ~ 6 Fh/ 9 , compared to theoretical values of be- 
tween 23 (for a thermal continuum) and 50 (for 
a hard ionising continuum) (Ferland L Osterbrock 
1985). In the case that the low value of the line ra- 
tio is solely due to conventional dust extinction, and 
resonant scattering of Lya photons is not important, 
this implies the true UV continuum flux should be 4- 
8 times its measured value, and, scaling the nebular 
continuum from Dickson et al. (1995), the contribu- 
tion of that component to be % 5 — 15 per cent. The 
opposite case, when Lya is suppressed solely by reso- 
nant scattering, and the extinction to the UV contin- 
uum is negligible, the contribution of the nebular con- 
tinuum would be % 50 per cent. However, if nebular 
continuum were to dominate the emission one might 
expect to see a steep rise towards shorter wavelengths 
across 91 2A [the “Lyman break” in an optically thin 
nebular continuum spectrum (Landini <k: Monsignori- 
Fossi 1990)] unless the Lya clouds are optically thick 
at the Lyman-limit when this radiation will be ab- 
sorbed. Again, however, a high optical depth at the 
Lyman limit should produce very strong absorption in 
Lya. Escape of Lya photons from such clouds would 
be very inhibited if there were only a small amount 
of dust present in them. 

The above discussion has served to highlight the 
problems associated with trying to understand the 
near-UV emission from high-5 radio galaxies. In this 
case, it is however clear that Lya observations at HST 
resolution could significantly improve the situation. 
They would allow the measurement of the Lya flux 
from the compact UV-emitting regions in the centre 
of the galaxy, enabling the presence or absence of an 
Hi screen between the UV-emitting region and the 
Lya halo to be established. High-resolution imaging 
across the Lyman-limit break would also allow regions 
emitting optically-thin nebular continuum to be easily 
identified, although narrow band filters must be used 
to avoid interference by intervening absorbers. 
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Table 2. Magnitudes and colours of the objects in the 4C41.17 field 
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